Profiling Report

Dataset statistics

Number of variables	8
Number of observations	13605401
Missing cells	5810
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	830.4 MiB
Average record size in memory	64.0 B

Variable types

Numeric	8

Alerts

`AMT_INSTALMENT` is highly overall correlated with `AMT_PAYMENT` and 1 other fields	High correlation
`AMT_PAYMENT` is highly overall correlated with `AMT_INSTALMENT`	High correlation
`DAYS_ENTRY_PAYMENT` is highly overall correlated with `DAYS_INSTALMENT`	High correlation
`DAYS_INSTALMENT` is highly overall correlated with `DAYS_ENTRY_PAYMENT`	High correlation
`NUM_INSTALMENT_NUMBER` is highly overall correlated with `NUM_INSTALMENT_VERSION`	High correlation
`NUM_INSTALMENT_VERSION` is highly overall correlated with `AMT_INSTALMENT` and 1 other fields	High correlation
`NUM_INSTALMENT_VERSION` has 4082498 (30.0%) zeros	Zeros

Reproduction

Analysis started	2025-02-02 10:45:39.076760
Analysis finished	2025-02-02 11:01:16.568616
Duration	15 minutes and 37.49 seconds
Software version	ydata-profiling vv4.12.2
Download configuration	config.json

SK_ID_PREV
Real number (ℝ)

Distinct	997752
Distinct (%)	7.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1903365

Minimum	1000001
Maximum	2843499
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	1000001
5-th percentile	1082903
Q1	1434191
median	1896520
Q3	2369094
95-th percentile	2749692
Maximum	2843499
Range	1843498
Interquartile range (IQR)	934903

Descriptive statistics

Standard deviation	536202.91
Coefficient of variation (CV)	0.28171313
Kurtosis	-1.2171478
Mean	1903365
Median Absolute Deviation (MAD)	467405
Skewness	0.042509604
Sum	2.5896044 × 10¹³
Variance	2.8751356 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2360056	293	< 0.1%
2592574	279	< 0.1%
1017477	248	< 0.1%
1449382	243	< 0.1%
1746731	236	< 0.1%
1690678	223	< 0.1%
2709164	222	< 0.1%
1383111	220	< 0.1%
1152155	219	< 0.1%
2543266	216	< 0.1%
Other values (997742)	13603002	> 99.9%

Value	Count	Frequency (%)
1000001	2	< 0.1%
1000002	4	< 0.1%
1000003	3	< 0.1%
1000004	7	< 0.1%
1000005	11	< 0.1%
1000007	5	< 0.1%
1000008	9	< 0.1%
1000009	6	< 0.1%
1000010	11	< 0.1%
1000011	12	< 0.1%

Value	Count	Frequency (%)
2843499	10	< 0.1%
2843498	6	< 0.1%
2843497	20	< 0.1%
2843496	34	< 0.1%
2843495	7	< 0.1%
2843494	2	< 0.1%
2843493	31	< 0.1%
2843492	12	< 0.1%
2843491	10	< 0.1%
2843490	4	< 0.1%

SK_ID_CURR
Real number (ℝ)

Distinct	339587
Distinct (%)	2.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	278444.88

Minimum	100001
Maximum	456255
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	100001
5-th percentile	118148
Q1	189639
median	278685
Q3	367530
95-th percentile	438474
Maximum	456255
Range	356254
Interquartile range (IQR)	177891

Descriptive statistics

Standard deviation	102718.31
Coefficient of variation (CV)	0.36889998
Kurtosis	-1.1970155
Mean	278444.88
Median Absolute Deviation (MAD)	88956
Skewness	-0.003354141
Sum	3.7883543 × 10¹²
Variance	1.0551051 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
145728	372	< 0.1%
296205	350	< 0.1%
453103	347	< 0.1%
189699	344	< 0.1%
186851	337	< 0.1%
172690	336	< 0.1%
418081	332	< 0.1%
192083	324	< 0.1%
434807	323	< 0.1%
209362	318	< 0.1%
Other values (339577)	13602018	> 99.9%

Value	Count	Frequency (%)
100001	7	< 0.1%
100002	19	< 0.1%
100003	25	< 0.1%
100004	3	< 0.1%
100005	9	< 0.1%
100006	16	< 0.1%
100007	66	< 0.1%
100008	35	< 0.1%
100009	51	< 0.1%
100010	10	< 0.1%

Value	Count	Frequency (%)
456255	74	< 0.1%
456254	19	< 0.1%
456253	14	< 0.1%
456252	6	< 0.1%
456251	7	< 0.1%
456250	50	< 0.1%
456249	12	< 0.1%
456248	46	< 0.1%
456247	134	< 0.1%
456246	33	< 0.1%

NUM_INSTALMENT_VERSION
Real number (ℝ)

High correlation Zeros

Distinct	65
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.8566373

Minimum	0
Maximum	178
Zeros	4082498
Zeros (%)	30.0%
Negative	0
Negative (%)	0.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	1
95-th percentile	2
Maximum	178
Range	178
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.0352157
Coefficient of variation (CV)	1.2084645
Kurtosis	259.6071
Mean	0.8566373
Median Absolute Deviation (MAD)	0
Skewness	9.5933946
Sum	11654894
Variance	1.0716716
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	8485004	62.4%
0	4082498	30.0%
2	620283	4.6%
3	237063	1.7%
4	55274	0.4%
5	48404	0.4%
6	17092	0.1%
7	16771	0.1%
9	8359	0.1%
8	7814	0.1%
Other values (55)	26839	0.2%

Value	Count	Frequency (%)
0	4082498	30.0%
1	8485004	62.4%
2	620283	4.6%
3	237063	1.7%
4	55274	0.4%
5	48404	0.4%
6	17092	0.1%
7	16771	0.1%
8	7814	0.1%
9	8359	0.1%

Value	Count	Frequency (%)
178	1	< 0.1%
73	1	< 0.1%
72	7	< 0.1%
68	1	< 0.1%
61	8	< 0.1%
59	1	< 0.1%
58	1	< 0.1%
57	1	< 0.1%
56	1	< 0.1%
55	1	< 0.1%

NUM_INSTALMENT_NUMBER
Real number (ℝ)

High correlation

Distinct	277
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	18.870896

Minimum	1
Maximum	277
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	4
median	8
Q3	19
95-th percentile	82
Maximum	277
Range	276
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	26.664067
Coefficient of variation (CV)	1.412973
Kurtosis	6.7051373
Mean	18.870896
Median Absolute Deviation (MAD)	5
Skewness	2.4975965
Sum	2.567461 × 10⁸
Variance	710.97246
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	1004160	7.4%
2	985716	7.2%
3	968279	7.1%
4	943502	6.9%
5	880007	6.5%
6	827973	6.1%
7	679739	5.0%
8	644708	4.7%
9	592473	4.4%
10	549140	4.0%
Other values (267)	5529704	40.6%

Value	Count	Frequency (%)
1	1004160	7.4%
2	985716	7.2%
3	968279	7.1%
4	943502	6.9%
5	880007	6.5%
6	827973	6.1%
7	679739	5.0%
8	644708	4.7%
9	592473	4.4%
10	549140	4.0%

Value	Count	Frequency (%)
277	1	< 0.1%
276	1	< 0.1%
275	2	< 0.1%
274	1	< 0.1%
273	2	< 0.1%
272	2	< 0.1%
271	2	< 0.1%
270	2	< 0.1%
269	2	< 0.1%
268	3	< 0.1%

DAYS_INSTALMENT
Real number (ℝ)

High correlation

Distinct	2922
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-1042.27

Minimum	-2922
Maximum	-1
Zeros	0
Zeros (%)	0.0%
Negative	13605401
Negative (%)	100.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	-2922
5-th percentile	-2553
Q1	-1654
median	-818
Q3	-361
95-th percentile	-81
Maximum	-1
Range	2921
Interquartile range (IQR)	1293

Descriptive statistics

Standard deviation	800.94628
Coefficient of variation (CV)	-0.76846335
Kurtosis	-0.79873706
Mean	-1042.27
Median Absolute Deviation (MAD)	557
Skewness	-0.62870396
Sum	-1.4180501 × 10¹⁰
Variance	641514.95
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-120	11512	0.1%
-180	11212	0.1%
-150	11194	0.1%
-119	11183	0.1%
-149	11144	0.1%
-210	11140	0.1%
-90	11135	0.1%
-148	10922	0.1%
-179	10838	0.1%
-59	10828	0.1%
Other values (2912)	13494293	99.2%

Value	Count	Frequency (%)
-2922	1327	< 0.1%
-2921	1436	< 0.1%
-2920	1458	< 0.1%
-2919	1485	< 0.1%
-2918	1454	< 0.1%
-2917	1443	< 0.1%
-2916	1391	< 0.1%
-2915	1422	< 0.1%
-2914	1462	< 0.1%
-2913	1522	< 0.1%

Value	Count	Frequency (%)
-1	2	< 0.1%
-2	661	< 0.1%
-3	5031	< 0.1%
-4	6157	< 0.1%
-5	6122	< 0.1%
-6	6458	< 0.1%
-7	6865	0.1%
-8	6893	0.1%
-9	6593	< 0.1%
-10	7003	0.1%

DAYS_ENTRY_PAYMENT
Real number (ℝ)

High correlation

Distinct	3039
Distinct (%)	< 0.1%
Missing	2905
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	-1051.1137

Minimum	-4921
Maximum	-1
Zeros	0
Zeros (%)	0.0%
Negative	13602496
Negative (%)	> 99.9%
Memory size	103.8 MiB

Quantile statistics

Minimum	-4921
5-th percentile	-2561
Q1	-1662
median	-827
Q3	-370
95-th percentile	-90
Maximum	-1
Range	4920
Interquartile range (IQR)	1292

Descriptive statistics

Standard deviation	800.58588
Coefficient of variation (CV)	-0.7616549
Kurtosis	-0.80175574
Mean	-1051.1137
Median Absolute Deviation (MAD)	557
Skewness	-0.62688908
Sum	-1.429777 × 10¹⁰
Variance	640937.76
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-91	13103	0.1%
-182	13090	0.1%
-154	13071	0.1%
-92	12646	0.1%
-245	12405	0.1%
-273	12151	0.1%
-119	11961	0.1%
-63	11938	0.1%
-153	11839	0.1%
-336	11839	0.1%
Other values (3029)	13478453	99.1%

Value	Count	Frequency (%)
-4921	1	< 0.1%
-3160	1	< 0.1%
-3129	1	< 0.1%
-3115	1	< 0.1%
-3096	1	< 0.1%
-3082	1	< 0.1%
-3078	1	< 0.1%
-3071	1	< 0.1%
-3063	1	< 0.1%
-3061	1	< 0.1%

Value	Count	Frequency (%)
-1	2	< 0.1%
-2	394	< 0.1%
-3	2610	< 0.1%
-4	3056	< 0.1%
-5	3049	< 0.1%
-6	3375	< 0.1%
-7	4309	< 0.1%
-8	4002	< 0.1%
-9	3748	< 0.1%
-10	4133	< 0.1%

AMT_INSTALMENT
Real number (ℝ)

High correlation

Distinct	902539
Distinct (%)	6.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	17050.907

Minimum	0
Maximum	3771487.8
Zeros	290
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	0
5-th percentile	188.145
Q1	4226.085
median	8884.08
Q3	16710.21
95-th percentile	47041.335
Maximum	3771487.8
Range	3771487.8
Interquartile range (IQR)	12484.125

Descriptive statistics

Standard deviation	50570.254
Coefficient of variation (CV)	2.9658396
Kurtosis	388.83939
Mean	17050.907
Median Absolute Deviation (MAD)	5509.08
Skewness	16.235905
Sum	2.3198443 × 10¹¹
Variance	2.5573506 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9000	254062	1.9%
2250	179120	1.3%
4500	174143	1.3%
6750	173659	1.3%
3375	149941	1.1%
5625	96362	0.7%
7875	60248	0.4%
1125	60224	0.4%
13500	42926	0.3%
8100	37295	0.3%
Other values (902529)	12377421	91.0%

Value	Count	Frequency (%)
0	290	< 0.1%
0.045	2059	< 0.1%
0.09	1508	< 0.1%
0.135	1680	< 0.1%
0.18	1644	< 0.1%
0.225	1004	< 0.1%
0.27	1373	< 0.1%
0.315	1114	< 0.1%
0.36	1184	< 0.1%
0.405	899	< 0.1%

Value	Count	Frequency (%)
3771487.845	1	< 0.1%
3473582.895	1	< 0.1%
3436835.13	1	< 0.1%
3371884.155	1	< 0.1%
3202061.805	1	< 0.1%
3199045.365	1	< 0.1%
3150949.545	1	< 0.1%
3116440.26	1	< 0.1%
3110086.215	1	< 0.1%
3094108.245	1	< 0.1%

AMT_PAYMENT
Real number (ℝ)

High correlation

Distinct	944235
Distinct (%)	6.9%
Missing	2905
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	17238.223

Minimum	0
Maximum	3771487.8
Zeros	1440
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	103.8 MiB

Quantile statistics

Minimum	0
5-th percentile	111.645
Q1	3398.265
median	8125.515
Q3	16108.425
95-th percentile	47732.175
Maximum	3771487.8
Range	3771487.8
Interquartile range (IQR)	12710.16

Descriptive statistics

Standard deviation	54735.784
Coefficient of variation (CV)	3.1752567
Kurtosis	324.59593
Mean	17238.223
Median Absolute Deviation (MAD)	5658.435
Skewness	14.951925
Sum	2.3448286 × 10¹¹
Variance	2.996006 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9000	248757	1.8%
2250	182654	1.3%
4500	178309	1.3%
6750	170360	1.3%
3375	141832	1.0%
5625	91165	0.7%
1125	64440	0.5%
7875	55823	0.4%
13500	46276	0.3%
8100	35271	0.3%
Other values (944225)	12387609	91.0%

Value	Count	Frequency (%)
0	1440	< 0.1%
0.045	4176	< 0.1%
0.09	3057	< 0.1%
0.135	3095	< 0.1%
0.18	2837	< 0.1%
0.225	2050	< 0.1%
0.27	2534	< 0.1%
0.315	1982	< 0.1%
0.36	2244	< 0.1%
0.405	2021	< 0.1%

Value	Count	Frequency (%)
3771487.845	1	< 0.1%
3473582.895	1	< 0.1%
3436835.13	1	< 0.1%
3371884.155	1	< 0.1%
3202061.805	1	< 0.1%
3199045.365	1	< 0.1%
3150949.545	1	< 0.1%
3116440.26	1	< 0.1%
3110086.215	1	< 0.1%
3094108.245	1	< 0.1%

	AMT_INSTALMENT	AMT_PAYMENT	DAYS_ENTRY_PAYMENT	DAYS_INSTALMENT	NUM_INSTALMENT_NUMBER	NUM_INSTALMENT_VERSION	SK_ID_CURR	SK_ID_PREV
AMT_INSTALMENT	1.000	0.916	0.225	0.228	-0.301	0.521	0.001	0.005
AMT_PAYMENT	0.916	1.000	0.222	0.225	-0.301	0.485	0.001	0.004
DAYS_ENTRY_PAYMENT	0.225	0.222	1.000	0.999	0.088	0.078	0.001	0.004
DAYS_INSTALMENT	0.228	0.225	0.999	1.000	0.083	0.084	0.001	0.004
NUM_INSTALMENT_NUMBER	-0.301	-0.301	0.088	0.083	1.000	-0.541	0.001	-0.001
NUM_INSTALMENT_VERSION	0.521	0.485	0.078	0.084	-0.541	1.000	-0.001	0.001
SK_ID_CURR	0.001	0.001	0.001	0.001	0.001	-0.001	1.000	0.002
SK_ID_PREV	0.005	0.004	0.004	0.004	-0.001	0.001	0.002	1.000

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

	SK_ID_PREV	SK_ID_CURR	NUM_INSTALMENT_VERSION	NUM_INSTALMENT_NUMBER	DAYS_INSTALMENT	DAYS_ENTRY_PAYMENT	AMT_INSTALMENT	AMT_PAYMENT
0	1054186	161674	1.0	6	-1180.0	-1187.0	6948.360	6948.360
1	1330831	151639	0.0	34	-2156.0	-2156.0	1716.525	1716.525
2	2085231	193053	2.0	1	-63.0	-63.0	25425.000	25425.000
3	2452527	199697	1.0	3	-2418.0	-2426.0	24350.130	24350.130
4	2714724	167756	1.0	2	-1383.0	-1366.0	2165.040	2160.585
5	1137312	164489	1.0	12	-1384.0	-1417.0	5970.375	5970.375
6	2234264	184693	4.0	11	-349.0	-352.0	29432.295	29432.295
7	1818599	111420	2.0	4	-968.0	-994.0	17862.165	17862.165
8	2723183	112102	0.0	14	-197.0	-197.0	70.740	70.740
9	1413990	109741	1.0	4	-570.0	-609.0	14308.470	14308.470

	SK_ID_PREV	SK_ID_CURR	NUM_INSTALMENT_VERSION	NUM_INSTALMENT_NUMBER	DAYS_INSTALMENT	DAYS_ENTRY_PAYMENT	AMT_INSTALMENT	AMT_PAYMENT
13605391	1499195	418486	6.0	32	-112.0	NaN	48635.595	NaN
13605392	2448869	434321	1.0	16	-117.0	NaN	11504.250	NaN
13605393	1285736	434069	0.0	73	-853.0	NaN	67.500	NaN
13605394	1659443	405841	0.0	102	-1888.0	NaN	67.500	NaN
13605395	1499195	418486	6.0	2	-1012.0	NaN	48635.595	NaN
13605396	2186857	428057	0.0	66	-1624.0	NaN	67.500	NaN
13605397	1310347	414406	0.0	47	-1539.0	NaN	67.500	NaN
13605398	1308766	402199	0.0	43	-7.0	NaN	43737.435	NaN
13605399	1062206	409297	0.0	43	-1986.0	NaN	67.500	NaN
13605400	2448869	434321	1.0	19	-27.0	NaN	11504.250	NaN

Overview

Interactions

Correlations

Missing values

Sample

Overview

Variables

Interactions

Correlations

Missing values

Sample